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GOVERNMENT SUPPORT 

This invention was supported, in whole or in part, by a grant from the National 
Cancer Institute, National Institute of Health, Grant No. 1R21CA89673-01A1. The 
Government has certain rights in the invention. 

5 CROSS REFERENCES TO RELATED APPLICATIONS 

The present application claims the benefit of U.S. Provisional Application No. 
60/418,065, filed October 11, 2002. The entire contents of the above applications are 
incorporated herein by reference in its entirety. 

BACKGROUND OF THE INVENTION 

10 The incidence of cancer, in particular breast cancer and cervical cancer, is still 

high according to the statistical data in the United States. Early detection of the cancer is 
extremely important for successful treatment. However, it is not easy for the radiologists 
to quickly and accurately diagnose the pathological changes by using the original medical 
images such as, for example, mammograms and Pap smears, in which the abnormal 

15 changes are buried in surrounding tissue. Therefore, it is important to explore techniques 
to enhance desired components and filter out undesired components present in the 
medical images so that the radiologist and/or pathologist and other medical personnel can 
easily make a diagnosis and prescribe appropriate treatment. 

Medical image processing with digital techniques is being increasingly used for 

20 such applications. It has been demonstrated that medical image processing is very helpful 
for the diagnosis. However, digital image processing is a manipulating-in-series method 
and is aided by computers and expensive electronic equipment. Often related software is 
complicated and time consuming for medical personnel to manipulate. Moreover, the 
digital methods also require many accessories for image sampling, transformations, 

25 processing, and output displays and results. 

There still remains a need for simple and cost-effective systems that assist in 
medical image processing. 
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SUMMARY OF THE INVENTION 

The preferred embodiments of the present invention are directed to cost effective 
optical systems for image processing, in particular processing of medical images, using 
optical Fourier systems and methods. Embodiments of the present invention include an 
5 optical Fourier system having real-time optical processors with spatial filters to generate a 
filtered image from an x-ray film, for example. A preferred embodiment can include a 
self-adaptive optical processor with non-linear optical films of the biomaterial 
Bacteriorhodopsin. The desired components present in medical images, for example, 
mammograms and Pap smear images, which are not clearly visible to the naked eye in 

10 original images are identifiable in the processed images. The image processing facilitates 
detection of lesions or microcalcifications located in dense tissue in the case of 
mammograms, and abnormal cells in Pap smears. The results are helpful for early 
diagnosis of cancers, for example, breast and cervical cancers. The systems of the 
preferred embodiments include a low-cost, durable, portable battery operated system for 

15 rapid screening of mammograms and Pap smears. 

A preferred embodiment optical system for processing a medical image includes 
an input image, a light source emitting a light beam which is directed at the input image, 
a first Fourier optical transformer receiving and focusing the light beam, and at least one 
spatial filter disposed at a Fourier plane which is located at the focus of the Fourier lens 

20 to generate a filtered Fourier spectrum. The system further includes a second optical 
Fourier transformer receiving the filtered Fourier spectrum and generating an inverse 
Fourier transform that results in a processed image. The system includes an image 
sensor to detect the processed image and generate an electronic representation of the 
processed image. In an embodiment, the input image is a two-dimensional image 

25 generated by a medical imaging method such as, for example, a mammogram or an 

image of a Pap smear that is located on a transmissive or reflective medium. The input 
image can be generated by at least one of an x-ray, magnetic resonance, computerized 
axial tomography and ultrasound imaging method. The light source can be a laser, such 
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as a diode pumped laser emitting light radiation having a wavelength in the range of 300 

to 800 nm or a lamp. 

In the optical Fourier system of the preferred embodiment, the first and second 

optical Fourier transformers are lenses. The image sensor of the optical Fourier system 
5 comprises a charge coupled device (CCD), a CMOS imaging device or other solid state 

pixellated imager in preferred embodiments. The optical Fourier system further includes 

a controller that is electronically connected to the image sensor, wherein the controller 

actuates the readout of the electronic representation from the image sensor. The system 

further includes a processor, for example, a computer, electrically coupled to the 
10 controller, an image storage device and a display device. 

In accordance with another aspect of the present invention, a method of 

processing an image using an optical Fourier system includes irradiating an input image 

with an input beam, focusing the input beam onto a Fourier plane and generating a 

Fourier spectrum using a first optical Fourier transformer. The Fourier spectrum is then 
15 filtered by applying at least one spatial filter to generate a filtered Fourier spectrum. A 

processed image is generated by using an inverse Fourier transformer, and the method 

includes detecting the processed image using an image sensor. 

In accordance with another aspect of the present invention, a preferred 

embodiment of the optical Fourier system is manufactured as a portable device having a 
20 weight in the range of approximately two to five pounds depending upon the light source 

used and a volume less than 5000 cm 3 , or in the range of approximately 30.5 cm x 5 cm 

x 5 cm to 50.8 cm x 10 cm x 10 cm. 

The foregoing and other features and advantages of the optical Fourier systems 

and methods for medical image processing will be apparent from the following more 
25 particular description of preferred embodiments of the system and method as illustrated in 

the accompanying drawings in which like reference characters refer to the same parts 

throughout the different views. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a diagram illustrating the principles of an optical Fourier system for 
medical image processing in accordance with a preferred embodiment of the present 
invention; 

5 Figure 2 illustrates a schematic diagram of an optical Fourier system for image 

processing in accordance with a preferred embodiment of the present invention; 

Figure 3 illustrates a plurality of filters used in an optical Fourier system in 
accordance with a preferred embodiment of the present invention; 

Figures 4A-4E illustrate original binary image and the results of the image 
10 processing using different filters shown in Figure 3 in accordance with a preferred 
embodiment of the present invention; 

Figures 5A-5C illustrate an original medical image (mammogram) and the 
processed images, respectively, using two different filters in accordance with a preferred 
embodiment of the present invention; 
15 Figures 6 A and 6B illustrate another original mammography image and the 

results of image processing, respectively, in accordance with a preferred embodiment of 
the present invention; 

Figure 7 illustrates a schematic diagram of an image processing system using 
non-linear dichromatic films instead of filters in accordance with a preferred embodiment 
20 of the present invention 

Figures 8A and 8B are an original mammogram image and an image processed 
using an optical Fourier system, respectively, in accordance with a preferred embodiment 
of the present invention; 

Figures 9A and 9B illustrate an original Pap smear image and an image processed 
25 using an optical Fourier system, respectively, in accordance with a preferred embodiment 
of the present invention; and 

Figure 10 is a flowchart of a method using optical Fourier systems to process 
medical images in accordance with a preferred embodiment of the present invention. 
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The drawings are not necessarily to scale, emphasis instead being placed upon 
illustrating the principles of the invention. 



DETAILED DESCRIPTION OF THE INVENTION 

Optical Fourier methods in accordance with the present invention are well suited 
5 for medical image processing. The optical Fourier transform is a powerful tool used in 
optical computing and processing systems. Preferred embodiments include parallel 
processing ability that approximates the speed of light and is well suited for medical 
image processing applications. With low-cost components like lenses, filters, mirrors 
and diode lasers, portable systems for image processing can be fabricated in accordance 

1 0 with preferred embodiments of the present invention. 

Preferred embodiments of the present invention included analyzing several 
medical images including, for example, mammograms and Pap smears using optical 
processors coupled to real-time optical systems having various filters. One embodiment 
includes a self-adaptive optical system having nonlinear optical films of the biomaterial 

15 Bacteriorhodopsin (BR). The regions of abnormal pathological changes which are 
unclear or invisible in the original images are identified in the processed images that 
result from the preferred embodiments. The results are very useful for the radiologists, 
and pathologists for diagnosis as well as successful treatment. 

The propagation of light in free space can be described conveniently by Fourier 

20 analysis. The complex amplitude of a monochromatic wave can be expanded as a 

superposition of harmonic components of different spatial frequencies. Each harmonic 
component corresponds to a plane wave and the plane wave traveling at different angles 
corresponds to different spatial frequencies. Since the spatial frequency reflects the 
information carried by light, the principle suggests that light can be used to compute and 

25 process the input information if pne can separate these waves. An optical lens can 

transform a plane wave into a paraboloidal wave focused to a point at the focal plane of 
the lens. Different waves with different spatial frequencies can be mapped to various 
points in the focal plane and thus the lens can separate the contributions of the different 
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frequency plane waves. This relatively simple method allows one to easily separate and 
process the light waves at the focal plane, i.e., Fourier transform by a lens and processing 
with various spatial filters. In order to enhance the pathological changes in the medical 
images, one needs to determine and locate their frequency region in the focal plane of the 
5 Fourier transform and then pass only the useful frequency components. Through an 
inverse Fourier transform with another Fourier lens, the processed frequencies can be 
reconstructed as image information, in which the undesired components in medical 
images are filtered out, displaying only the desired components. 

Figure 1 is a schematic diagram illustrating an optical Fourier system 10 for 

10 medical image processing in accordance with a preferred embodiment of the present 

invention. Light from a light source 12 is incident on a two-dimensional image 14, such 
as, for example, an x-ray film. The light source illuminates the input image with a 
uniform intensity of approximately 1 .5 milliwatt/cm 2 . The power of the light source is 
approximately 20 milliwatts. The size of the input image film is approximately 2.54 cm 

15 x 2.54 cm. The light beam propagates through the two-dimensional input image and is 
transmitted to a Fourier lens 16. The light is spatially transformed to result in a Fourier 
spectrum 18 as the light waves are separated at the focal plane of the lens 16. Spatial 
filters 20 are then used to selectively filter low or high spatial frequencies to result in a 
filtered spectrum. The filters are located at the focus of the Fourier lens. A lens 22, for 

20 example, a second Fourier lens provides for an inverse Fourier spectrum of the filtered 
spectrum. The processed frequencies can now be reconstructed as image information 
displaying the desired components of the image. A post processor and display subsystem 
can analyze and/or display the processed image. 

In a preferred embodiment, the processed image is optically coupled to a detector, 

25 for example, a charge coupled device (CCD) or CMOS imaged device 24. The CCD can 
be, for example, a two-dimensional array of detectors integrated into a single compact 
electronic chip. The CCD sensor 24 converts photons to electrons using closely spaced 
metal-oxide-semiconductor (MOS) diodes and thereby generates a discrete electronic 
representation of a received optical image. The discrete representation in the CCD is 
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read out by a controller 26. The controller 26 reads the image representation from the 
CCD sensor pixel by pixel and organizes it into a digital array. The digital array can then 
be output to a memory or image store 30. From the image store 30, the image can be 
accessed by a data processor 28 for performing any post-processing. A cathode ray tube 
5 (CRT) 32 or other type of electronic image display is provided to allow the image to be 
displayed before or after processing by the data processor 28. 

Figure 2 illustrates a schematic diagram of the optical Fourier system in 
accordance with a preferred embodiment of the present invention. A small diode 
pumped laser with a 532 nm output is used as a light source. The light source can be any 

1 0 laser emitting a wavelength in the range of approximately 300-800 nm. The laser light 
beam 41 is expanded to a spatial uniform beam by using a microlens and pin hole filter 
42, and is then collimated by a lens 43. The optical elements, for example, the lens and 
polarizers can be supplied by, for example, Newport Corporation of Irvine, California 
and Edmund Industrial Optics of Barrington, NJ. After illuminating the entire input 

1 5 image 44, the laser beam is focused by a lens 45 (Fourier lens). At the Fourier plane 46, 
various spatial filters 47 are applied for image processing. These spatial filters can 
include glass slides that have been selectively masked. Through an inverse Fourier 
process by using a reverse Fourier lens 48, the processed frequency components in the 
Fourier plane are converted back to image format 49 which is detected by using, for 

20 example, a CCD detector. Thus, both binary images, for example, the letter E, and 

medical images are analyzed by using optical Fourier processor methods in accordance 
with a preferred embodiment of the present invention with several spatial filters. 

Different frequency components in the images can be spatially separated at the 
Fourier plane. Figure 3 illustrates several filters fabricated in accordance with a 

25 preferred embodiment of the present invention in order to select desired frequency bands 
for medical image processing. Filters 62 and 64 can be shifted from left to right for 
increasing the area to block low frequencies wherein the area blocking the light is 
changed discontinuously in filter 62 and continuously in filter 64. The filters 66 and 68 
can change a transparent region, the white region in the filters, continuously and radially 
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by enlarging or reducing the sizes of circles. The desired components of the images can 
be enhanced by using suitable filters and adjusting the filters to block undesirable 
frequency bands. 

Figures 4A-4E illustrate the original binary image and the results of the image 
5 processing with different filters in accordance with a preferred embodiment of the 
present invention. By using the filters 62, 64 and 66, shown in Figure 3, image edge 
enhancements are obtained as the filters function to block the low frequency components. 
In the original image two very thin filaments 82, 84 were placed by design in the top left 
corner of the original image 80. The filaments, indicated by arrows 82, 84, are not very 

10 clear in the original image, but can be clearly seen in the processed images with the 
filters 62, 64, and 66 (Figures 4B-4D, respectively). The resultant image, Figure 4D, 
with filter 66 is better than those obtained with the other two filters 62, 64. The image 
(Figure 4B) processed by the filter 62 has blurry edges and the image (Figure 4C) 
processed by the filter 64 shows weak enhancements in vertical edges, but is clear with 

1 5 respect to horizontal edges. The reason is that the filters 62 and 64 only block low 

frequency bands, the filter 64 blocks more components in horizontal direction. However, 
the filter 66 enables to scan different frequency regions by expanding or contracting the 
annular ring and selecting an appropriate frequency band to process. On the other hand, 
the filter 68 (Figure 4E) blocks all of the high frequency components but passes low 

20 frequency components, and thus the processed image (Figure 4E) becomes soft with no 
sharp edges. Thus, the filaments 82, 84 become more blurry as they correspond to the 
high frequencies. The results demonstrate that the system in accordance with a preferred 
embodiment of the present invention can be used to enhance some useful components 
and block undesirable components in the images. 

25 Figures 5A-5C illustrate the original medical images (mammograms) and the 

results of a mammogram processed by using filters 66 and 68 shown in Figure 3. The 
region of abnormal pathological changes is pointed by an arrow 102 in the original image 
(Figure 5A). Mammography is a specific type of imaging that uses a low-dose x-ray 
system and high-contrast, high-resolution film for examination of the breasts. Most 
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medical experts agree that successful treatment of breast cancer often is linked to early 
diagnosis. Mammography plays a central part in early detection of breast cancers 
because it can show changes in the breast up to two years before a patient or physician 
can feel them. A radiologist, who is a physician experienced in mammography and other 
5 x-ray examinations, analyzes the images, describes any abnormalities, and suggests a 
likely diagnosis. The system in accordance with a preferred embodiment of the present 
invention is useful for the radiologist as they identify the presence of any abnormalities. 

The image shown in Figure 5B is the processed image with the filter 66, in which 
the abnormal pathological changes (microcalcifications) are identified since they 

10 correspond to higher frequency bands as compared to the surrounding tissue. The image 
shown in Figure 5C is processed by the low pass filter 68 and shows mostly the 
surrounding tissue corresponding to low spatial frequencies. 

Figures 6A and 6B illustrate the original mammography image and the results of 
image processing with a second mammogram, respectively. The regions with 

1 5 microcalcifications 1 16 which are invisible in the original image have been clearly 
identified in the processed image (Figure 6B). 

In accordance with another aspect of the present invention, the medical image can 
be processed by using nonlinear optical processors with photo-induced anisotropic 
materials such as biological bacteriorhodopsin (BR) films and organic azobenzene films. 

20 The optical materials functionalized with BR and azobenzene compounds have shown 
great promise as candidates for the applications in photonic technology because of their 
high inherent optical nonlinearities which originate from molecular structure and 
absorption changes upon light irradiation. Many studies have been reported on these 
materials in the field of optical nonlinearities and their applications, such as wave 

25 mixing, holographic storage, real-time spatial light modulator and image information 
processing. 

The BR and azobenzene materials possess large photo-induced anisotropic effects 
under illumination of linearly-polarized light. The photo-induced anisotropy enables to 
control the polarization states of incoming probe beam, and thus it can be used to process 
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or compute the information carried by the light beams. The photo-induced dichromatic 
property of the BR films can be used to achieve a real-time, self adaptive spatial filtering 
system in medical image processing in accordance with a preferred embodiment of the 
present invention. Figure 7 illustrates a schematic diagram of such an image processing 
5 system using non-linear dichromatic films such as, for example, BR films in accordance 
with a preferred embodiment of the present invention. Systems and methods for optical 
Fourier processing based on photochromic materials is described in U.S. Patent No. 
5,854,710, to Rao et al, the entire teachings of which are incorporated herein by 
reference. Similar to the system shown in Figure 2, an expanded and uniform beam from 

10 a light source, such as, for example, a diode pump laser emitting a light beam with a 532 
nm wavelength is incident on a collimating lens 132. A vertical polarizer 133 and a 
horizontal analyzer 138 are applied to the system (in front of input image 134 and output 
image 139, respectively). The filter in Figure 2 is replaced by the nonlinear optical BR 
film 136 in the Fourier transform plane. The BR film 136 is also irradiated by an actinic 

1 5 beam 140 which is linearly polarized at 45° from the vertical direction by a 45° polarizer 
141. This optical system is real-time and self-adaptive. 

In this embodiment, the photo-induced (dichromatism) anisotropy of the BR film 
depends on the intensity of polarized actinic beam. The resulting polarization rotation of 
a linear-polarized probe beam is also intensity-dependent. It is observed that the rotation 

20 of the probe polarization reached a maximum angle for an optimum actinic beam 

intensity of about 10 mW/cm 2 and decreased with further increase of the actinic beam 
intensity. Since the actinic beam is Gaussian with a higher intensity distribution in the 
beam center than in the beam edge, the resulting photo-induced anisotropy (photo- 
induced dichromatism is dominant for the BR film) is spatially different in the BR film. 

25 When a probe beam carrying the medical image information is transformed to the BR 
film through the Fourier lens 135, the polarizations of Fourier frequency components of 
the medical image information are rotated by different angles according to the spatial 
intensity distribution of the actinic beam in the film. This is a polarization encoding 
process in which the different frequency components of the medical image are encoded 
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as different polarization directions. By adjusting the whole intensity of the Gaussian 
actinic beam, the maximum angle of polarization rotation is shifted radially along with 
the beam radius to a desired region with the optimum intensity. By using another 
polarizer (analyzer) and rotating its polarization angle, one can easily scan and select the 
5 useful components and filter out undesirable components. As a result, the desired 

components in the original image are enhanced. The function of this filtering process is 
similar to that using the filter 66 illustrated in Figure 3. 

Additional images of a clinical mammogram and a Pap smear are processed with 
an optical frequency system in accordance with a preferred embodiment of the present 

10 invention. Figures 8 A and 8B illustrate an original mammogram image and an image 
processed using the system in accordance with a preferred embodiment of the present 
invention, respectively. As compared to the original mammogram 150, the processed 
image 160 clearly displays the sites of probable microcalcification clusters. 

Figures 9A and 9B illustrate an original Pap smear image and a processed image 

1 5 using a system in accordance with a preferred embodiment of the present invention. In 
many cases, the cellular abnormalities related to pathologic entities present in the cervix 
can be detected and characterized by means of the Pap smear, based on the morphologic 
alternations of cells created by these entities, and on the presence of inflammatory cells 
and/or the actual presence of microbiologic agents. The cervical/vaginal Pap smear is an 

20 adequately collected cellular sample derived from exfoliated or mechanically dislodged 
cells of the vagina, cervix, and in some cases, endometrium, which have been smeared 
on a glass slide, adequately preserved and stained, and evaluated cytomorphologically for 
one or more of the following purposes, such as, detection of occult pathologic 
abnormalities of the uterine cervix in asymptomatic women, detection of recurrence of 

25 known pathologic abnormalities of the uterine cervix, evaluation of a suspected 

hormonal abnormality, and monitoring of hormonal therapy. Pap smears are read by 
cytotechnologists and pathologists. Cytotechnologists are specially trained to identify 
cell abnormalities. They systematically inspect the entire Pap smear for abnormal cells. 
Any abnormality is marked for further evaluation by a pathologist. The system in 
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accordance with a preferred embodiment of the present invention assists the pathologist 
in making a diagnosis. The bright spots in the original image represent the cells. Both 
normal 172 (small spots) and abnormal cells 174 (large cluster) are visible in the original 
image. In the processed image, the normal cells are filtered out retaining only the 
5 abnormal cells 182. This is achieved by selectively filtering out high spatial frequency 
components in the Fourier transform. 

The methods in accordance with a preferred embodiment of the present invention 
for medical image processing by using optical Fourier techniques provide image edge 
enhancement and identification of pathological changes such as, for example, 

10 microcalcifications buried in dense tissue. Results obtained with a mammogram and a 
Pap smear are encouraging, demonstrating the feasibility of a low cost portable 
instrument for cancer diagnostics. The invisible abnormal regions in the original medical 
images can be clearly identified using systems in accordance with a preferred 
embodiment of the present invention. This is important for doctors to make a fast and 

15 correct diagnosis. As compared to digital image processing methods, the systems for 
medical image processing in accordance with a preferred embodiment of the present 
invention use optical Fourier methods that are cost-effective and fast. A preferred 
embodiment includes a portable and small-sized device having a weight of 
approximately five pounds and dimensions of approximately (20 inches x 4 inches x 4 

20 inches) 50.8 cm x 10 cm x 10 cm and can be fabricated with ease. The device requires 
weak light intensity to function. 

In an alternate embodiment, having diode lasers such as, for example, supplied by 
Coherence Incorporated of Santa Clara, California the size of the device is further 
reduced to about (12 inches x 2 inches x 2 inches) 30.5 cm x 5 cm x 5 cm and a weight 

25 of approximately two pounds. 

Figure 10 is a flowchart illustrating a method 200 using the optical Fourier 
system in accordance with a preferred embodiment of the present invention. The method 
includes the step 202 of illuminating a two-dimensional image with the uniform 
expanded laser beam. The beam is then focused by a Fourier lens in step 204 to generate 
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a Fourier spectrum per step 204. At the Fourier plane, various filters are applied for 
image processing to generate a filtered Fourier spectrum per step 210. By using another 
lens for inverse Fourier processing, the processed frequency components are converted 
back to image format per step 212 which is detected by using a CCD camera 214. The 
5 processed images can be stored in a processor for post-processing analysis per step 216. 
The regions of abnormal pathological changes, for example, the microcalcifications are 
identified since they correspond to higher frequency bands as compared to the 
surrounding tissue. The processed results are very helpful for diagnosis of different 
cancers, for example, breast cancer and it is possible to fabricate a device which is low- 

10 cost and portable. A preferred embodiment of the present invention includes plastic 
Fourier lens with adequate precision which results in a disposable system. 

In view of the wide variety of embodiments to which the principles of the present 
invention can be applied, it should be understood that the illustrated embodiments are 
exemplary only, and should not be taken as limiting the scope of the present invention. 

15 For example, the steps of the flow diagrams may be taken in sequences other than those 
described, and more or fewer elements may be used in the block diagrams. While 
various elements of the preferred embodiments have been described as being 
implemented in software, other embodiments in hardware or firmware implementations 
may alternatively be used, and vice- versa. 

20 It will be apparent to those of ordinary skill in the art that methods involved in the 

system and method for determining and controlling contamination may be embodied in a 
computer program product that includes a computer usable medium. For example, such 
a computer usable medium can include a readable memory device, such as, a hard drive 
device, a CD-ROM, a DVD-ROM, or a computer diskette, having computer readable 

25 program code segments stored thereon. The computer readable medium can also include 
a communications or transmission medium, such as, a bus or a communications link, 
either optical, wired, or wireless having program code segments carried thereon as digital 
or analog data signals. 
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The claims should not be read as limited to the described order or elements unless 
stated to that effect. Therefore, all embodiments that come within the scope and spirit of 
the following claims and equivalents thereto are claimed as the invention. 
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